B385 

Mo.    1323   COPY   2 


STX 


BEBR 

FACULTY  WORKING 
PAPER  NO.  1323 


IKE  | 

FEB  1  9 1987 


UNI» 


A  Comparison  of  Cognitive  Structure  and  Cognitive 
Response  Approaches  for  Measuring  Advertising  Effects 
on  Product  Attribute  Beliefs 

Manoj  Hastak 


College  of  Commerce  and  Business  Administration 
Bureau  of  Economic  and  Business  Research 
University  of  Illinois,  Urbana-Champaign 


BEBR 


FACULTY  WORKING  PAPER  NO.  1323 
College  of  Commerce  and  Business  Administration 
University  of  Illinois  at  Urbana-Champaign 
February  1987 


A  Comparison  of  Cognitive  Structure  and  Cognitive  Response 
Approaches  for  Measuring  Advertising  Effects  on 
Product  Attribute  Beliefs 

Manoj  Hastak,  Assistant  Professor 
Department  of  Business  Administration 


Digitized  by  the  Internet  Archive 

in  2012  with  funding  from 

University  of  Illinois  Urbana-Champaign 


http://www.archive.org/details/comparisonofcogn1323hast 


A  COMPARISON  OF  COGNITIVE  STRUCTURE  AND  COGNITIVE  RESPONSE 
APPROACHES  FOR  MEASURING  ADVERTISING  EFFECTS  ON 
PRODUCT  ATTRIBUTE  BELIEFS 

Manoj  Hastak 
The  University  of  Illinois 
at  Urbana-Champaign 


Abstract 
Two  indices  of  belief  structure  based  on  cognitive  response 
protocols  and  post  ad-exposure  measures  of  attribute  beliefs  are 
compared  for  their  ability  to  predict  and  mediate  advertising  effects 
on  attitude  and  intention  measures.   Results  indicate  the  value  of  a 
cognitive  response  approach  for  measuring  ad  effects  on  salient  brand 
beliefs.   Some  implications  for  future  research  are  discussed. 


Introduction 

Fishbein's  (1963,  Fishbein  and  Ajzen  1975)  model  of  attitude 
formation  and  change  has  enjoyed  enormous  popularity  in  the  marketing 
and  advertising  literatures  for  quite  some  time  now.   The  model 
proposes  that  beliefs  about  salient  product  attributes  are  the 
determinants  of  attitude,  and  hence  are  the  mediators  of  attitude 
change.   The  popularity  of  this  model  among  advertising  practitioners 
can  be  traced  directly  to  its  diagnostic  and  predictive  qualities. 
Advertising  effects  on  individual  belief  and  evaluation  elements  can  be 
examined  to  accurately  pinpoint  the  reasons  for  failure  to  achieve 
intended  levels  of  impact  on  brand  attitude  (A^j.)  or  behavioral 
intention  (BI).   Also,  the  expectancy-value  index  of  cognitive 
structure  (Eb^e^,  summed  over  all  salient  attributes)  can  be  used  to 
predict  post-exposure  attitude. 

A  test  of  the  Fishbein  model  requires  that  belief  and  evaluation 
measures  be  obtained  for  only  those  attributes  that  were  salient  during 
ad  exposure.   Unfortunately,  this  is  almost  never  done  in  consumer 
behavior  studies.   In  most  cases,  a  structured  questionnaire  designed 
to  measure  belief  strength  and  evaluation  on  attributes  that  are 
"modally"  salient  for  the  target  population  is  administered  after 
subjects  have  viewed  the  advertisement.   This  procedure  has  several 
problems  (Lutz  and  Swasy  1977:  Mitchell  and  Olson  1981).   Subjects  are 
clearly  forced  to  rate  some  attributes  that  are  not  salient  to  them. 
In  fact,  the  act  of  rating  attributes  may  itself  make  some  attributes 
salient.   Furthermore,  attributes  that  are  salient  for  a  small  fraction 
of  the  target  population  (i.e.,  not  modally  salient)  would  not  be 


-2- 

captured  by  the  study  questionnaire.   Thus,  the  measured  set  of  beliefs 
and  evaluations  would  only  partially  capture  the  target  set  of  beliefs 
and  evaluations  on  salient  attributes.   It  is  therefore  not  surprising 
that  most  consumer  behavior  studies  have  found  brand  attribute  beliefs 
to  mediate  some,  but  not  all  of  advertising  effects  on  brand  evaluation 
(e.g.,  Mitchell  and  Olson  1981). 

The  cognitive  response  model  (Wright  1980)  and  its  associated 
thought  verbalization  methodology  provides  an  alternative  approach  for 
identifying  and  rating  salient  attributes  (Lutz  and  Swasy  1977).   Those 
attributes  that  were  explicitly  mentioned  by  subjects  in  their 
cognitive  response  protocols  were  presumably  salient  during  message 
reception.   Thus,  subjects  could  be  asked  to  rate  these  attribute- 
specific  responses  on  belief  strength  and  evaluation  dimensions  using 
procedures  similar  to  those  used  in  the  structured  post-questionnaire. 
An  advantage  of  this  approach  is  that  it  provides  measurements  on 
attributes  that  were  idiosyncrat ical ly  salient  during  ad  exposure — 
something  that  the  structured  questionnaire  approach  does  not  do.   On 
the  other  hand,  cognitive  response  protocols  seem  less  likely  to 
capture  message  effects  on  salient  external  beliefs  (i.e.,  beliefs  not 
mentioned  in  the  message)  or  effects  via  non-verbal  processes.   Such 
effects  mi^ht  best  be  indicated  by  a  forced,  post-exposure 
questionnaire. 

In  sum,  the  two  approaches  that  were  discussed  seem  to  be  measuring 
slightly  different  aspects  of  the  true  underlying  belief  structure  for 
an  advertised  brand.   Thus,  it  would  be  interesting  to  compare  indices 
of  belief  structure  derived  from  these  approaches  in  terms  of  their 
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ability  to  predict  postexposure  attitude,  and  to  mediate  message- 
induced  attitudinal  effects.   Furthermore,  since  the  two  approaches 
appear  to  have  complementary  strengths  and  weaknesses,  it  would  be 
interesting  to  see  if  using  both  indices  simultaneously  would  improve 
predictive  and  mediational  performance.   These  issues  were  addressed  in 
the  present  study. 

Method 
The  data  came  from  a  larger  study  designed  to  test  cognitive 
response  mediation  in  an  advertising  context.   Only  relevant  aspects  of 
the  design  and  measurement  procedures  are  described  here.   The  design 
was  a  2  (product)  by  2  (message  quality)  factorial.   Two  products 
(white  bread  and  ball  point  pen)  were  used  to  examine  product  specific 
differences.   Since  these  were  substantial,  we  have  reported  results 
based  on  analyses  conducted  separately  for  the  two  products.   The 
message  quality  factor  was  designed  to  produce  large  effects  on 
post-exposure  A^r  and  Bl  scores,  and  thus  provide  opportunities  for 
examining  mediation  effects.   Two  versions  of  full  color  print  ads  for 
each  of  the  two  products  were  created  by  a  professional  artist.   The 
ads  were  for  fictitious  brands.   Both  versions  claimed  that  the 
advertised  brand  possessed  a  desirable  characteristic  (nutritional 
quality  for  white  bread,  consistency  of  ink  flow  for  ball  point  pen), 
but  gave  either  compelling  or  uncompelling  reasons  for  accepting  the 
claim  (good  versus  poor  quality  message).   This  message  quality 
manipulation  has  been  previously  used  by  Petty  and  Cacioppo  in  several 
persuasion  studies  (e.g.,  Petty  and  Cacioppo  1984). 
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Eighty  student  subjects  were  exposed  to  the  experimental  ad 
embedded  in  other  (real)  print  ads,  and  provided  their  cognitive 
responses  immediately  after  exposure.   Then,  they  responded  to  a 
structured  questionnaire  which  measured  belief  strength  (b^)  and 
evaluation  (e^)  for  "modally"  salient  attributes,  brand  attitude  (Ai  )  , 
attitude  towards  the  act  of  brand  purchase  (Aact),  and  behavioral 
intention  (BI). 

The  cognitive  responses  were  coded  in  two  ways.   First,  each 
subject  rated  all  of  his/her  thoughts  on  a  7-point  bipolar 
(positive-negative)  scale.   Second,  two  independent  judges  identified 
those  thoughts  that  were  targetted  at  a  specific  product  attribute. 
Interjudge  reliability  was  0.92.   Disagreements  were  resolved  by  mutual 
discussion. 

Re  s  u 1 1  s 

Two  indices  of  belief  structure  were  developed  from  these  data. 
First,  an  expectancy-value  index  (Eb^e^/n,  n  =  number  of  attributes) 
was  developed  based  on  the  questionnaire  responses  for  each  product, 
This  index  is  labelled  the  cognitive  structure  (or  CS)  index  of  belief 
structure.   Second,  the  evaluation  ratings  for  attribute-specific 
cognitive  responses  were  summed  and  divided  by  the  number  of  responses 
(Ee^/n)  to  yield  a  cognitive  response  (or  CR)  index  of  belief 
structure. 

The  ability  of  these  indices  to  predict  A^r ,  Aact ,  and  BI  scores 
was  examined  in  a  series  of  regression  runs  (Table  1),   For  white 
bread,  the  CS  index  proved  to  be  a  marginally  superior  predictor  for 


-5- 


two  of  the  three  dependent  variables.   Also,  including  both  pre-dictor 

n 

variables  in  the  model  significantly  improved  R  in  all  three  cases. 
For  ball  point  pen,  the  CR  index  was  a  substantially  superior  predictor 
for  all  three  dependent  variables.   Also,  using  both  predictor 
variables  marginally  improved  the  prediction  for  A^r  (increase  in  R^ 
was  significant  at  p  <  .05),  but  not  for  Aact  or  BI. 

Several  covariance  analyses  were  run  to  see  if  there  were  any 
differences  in  the  extent  to  which  the  two  belief  structure  indices 
mediated  significant  effects  due  to  the  message  quality  factor  on  A^r , 
Aact,  and  BI  scores  (Table  2).   For  white  bread,  both  indices 
independently  mediated  about  equal  amounts  of  these  treatment  effects. 
Using  both  indices  in  the  same  covariance  model  increased  the  observed 
mediation  levels — two  of  the  residual  F-Ratios  (for  k^r   and  BI)  were 
nonsignificant.   For  ball  point  pen,  the  CR  index  emerged  as  the 
stronger  mediator,  but  the  residual  F-Ratios  were  still  significant. 
Furthermore,  using  both  indices  as  simultaneous  covariates  did  not 
improve  the  mediation  magnitudes. 

Discussion 
Our  results  clearly  suggest  that  cognitive  response  data  can  be 
used  to  indicate  advertising  effects  on  salient  product  beliefs.   The 
cognitive  response  index  of  belief  structure  mediated  a  substantial 
proportion  of  the  treatment-induced  variation  in  brand  evaluation  and 
intention  scores,  and  clearly  outperformed  the  CS  index  (based  on 
post-exposure  data)  for  one  of  two  products.   This  suggests  that  the 
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cognitive  response  approach  is  a  viable,  and  in  some  instances  the 
preferred  approach  for  measuring  advertising  impact  on  cognitive 
structure  variables. 

The  improved  prediction  and  mediation  levels  obtained  when  both 
indices  were  included  in  the  analysis  for  white  bread  data  suggest  that 
using  both  measurement  approaches  simultaneously  may  provide  more 
diagnostic  and  predictive  power  than  when  either  approach  is  used 
alone.   However,  these  results  were  not  obtained  for  the  pen  data — 
thus,  mediators  other  than  brand  attribute  beliefs  may  also  be 
operating.   For  example,  Mitchell  and  Olson  (1981,  among  others)  have 
shown  that  attitude  towards  the  advertisement  (Aa(j)  contributes 
significantly  to  the  prediction  of  A^r   beyond  that  explained  by 
attribute  beliefs.   However,  the  precise  mechanisms  underlying  Aac| 
effects  are  still  unclear,  and  deserve  research  attention.   In 
particular,  Mitchell  and  Olson's  suggestion  that  Aacj   may  be  partly 
capturing  ad  effects  on  salient  but  unmeasured  beliefs  needs  to  be 
invest  igated. 

Finally,  it  should  be  noted  that  the  CR  index  of  belief  structure 
used  in  this  study  was  based  only  on  the  evaluation  ratings  provided  by 
subjects  for  attribute-specific  cognitive  responses.   Measures  of 
belief  strength  for  these  responses  were  not  obtained  (and  thus  were 
uniformly  equal  to  1  by  default).   A  problem  in  obtaining  these 
measures  is  that  they  necessitate  a  one-on-one,  depth  interview  type 
data  collection  procedure  (see  Lutz  and  Swasy  1977  for  details). 
Nevertheless,  incorporating  measures  of  both  belief  strength  and 
evaluation  may  considerably  improve  the  predictive  power  of  the  CR 
index.   This  remains  an  empirical  issue  for  future  investigation. 
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TABLE  1 


Alternative  Models  for  Predicting  A,  ,  A    ,  and  BI 

br   act 

(Beta  Coefficients  and  t-Statistics) 


Criterion 
Product     Variable      Model 


White         A  1 

Bread  2 


3 


A  ,.         l 
act  p 

3 


BI  1 

2 
3 


Ball 

Point         A,  1 

Pen  br  2 

3 


A  ,  l 

act  2 

3 

BI  1 

2 
3 

ap  <  .05,    bp  <  .01 


CS  Index  of 
Belief  Structure 

CR  Index  of 
Belief  Structure 

R2 

.74 
.52 

(6.72)b 
(3.72)b 

.67 
.32 

(5.56)b 
(2.27) 

.54 
.45 
.60 

.74 
.44 

(6.70)b 
(3.34)b 

.74 
.44 

(6.72)b 
(3.37)D 

.54 
.54 
.65 

.76 
.49 

(7.23)b 
(3.83)b 

.73 

.41 

(6.67)b 
(3.19)b 

.58 

.54 
.67 

.56 
.26 

(4.12)b 
(2.02)3 

.70 
.47 

(6.12)b 
(4.41)D 

.31 

.50 
.55 

.62 
.26 

(3.78)b 
(1.86) 

,64 
.51 

(5.14)b 
(3.59)b 

.27 
.41 
.46 

.50 
.25 

(3.52)b 
(1.68) 

.61 
.48 

(4.75)b 

(3.30) 

.25 
.37 
.42 

TABLE  2 

Effect  of  Covariates  on  the  F-Ratio  for  the  Effect 

of  Message  Quality  on  A,  ,  A    .  and  BI 
°      x     J  br   act 


Univariate  F-Rat 

io  for 

Product 

Covariate(s) 
No  Covariate 

Multivariate  F 
10.60b 

Abr 
22.16b 

Aact 
31.83b 

11 

White 

24.72b 

Bread 

11.06b 

CS  Index  for 

3.86a 

5.47a 

6.56a 

Belief  Structure 

(A) 

CR  Index  for 

3.503 

6.07a 

10.31b 

6.37a 

Belief  Structure 

(B) 

A  and  B 

2.34 

3.07 

6.66a 

3.27 

Ball 

No  Covariate 

12. 72b 

38.02b 

30.95b 

30.46b 

Point 
Pen 

CS  Index  for 
Belief  Structure 
(A) 

9.17b 

27.11b 

21.09b 

20.83b 

CR  Index  for 

3.28a 

9.02b 

7.90b 

8.70b 

Belief  Structure 

(B) 

A  and  B 

3.45a 

9.47b 

8.13b 

8.05b 

P  <  - 

.05, 

bP  <  .01 

